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Abstract 

Every cancer treatment, irrespective of its clinical effectiveness, has an impact on patients' quality of life (QoL). Even 
recently developed targeted therapies might have side effects and significantly impact patients' QoL Thus, 
understanding the advantages and disadvantages of different treatments from the patient's standpoint has become 
a must in clinical research and is highly valued by major stakeholders. Thousands of cancer patients are enrolled 
into randomized controlled trials (RCTs) each year and many complete patient-reported outcome (PRO) instruments 
to obtain patient-centered information as part of the assessment of the overall effectiveness of the new therapy. 
Some of these RCTs have generated high quality PRO evidence forming the basis for approval (or support to 
approval) of drugs by the US Food and Drug Administration. However, a consistent strategy to determine the 
quality of patient centered evidence presented in RCTs has until recently been lacking. One of the fundamental 
questions when including PROs in clinical research revolves around methodological robustness and consistency of 
outcome reporting. Cancer patients, physicians and healthcare system stakeholders need to rely on solid 
information to make the best possible choice regarding treatment. Therefore generating high-quality findings from 
PRO assessment in cancer trials is of paramount importance. In an effort to improve quality of PRO assessment and 
reporting in the near future, the Patient-Reported Outcome Measurements Over Time In ONcology (PROMOTION) 
Registry was developed. The scope of this Registry is to identify, track, analyse, and store information on all cancer 
RCTs that have included PROs, and assess the quality of their PRO assessments. 
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HEALTH AND QUALITY 
OF LIFE OUTCOMES 



Background 

Cancer is now an increasingly common diagnosis world- 
wide as population longevity increases. Recent data from 
the International Agency for Cancer research (IARC) indi- 
cate approximately 14.1 million new cancer cases in 2012, 
a rise of more than 10% compared to 2008 (12.7 million 
cases), and further projections suggest an increase to 19.3 
million new cancer cases per year by 2025 [1]. Therefore, 
understanding how cancer and its treatment impact on 
each aspect of a patients life is critical and remains a 
major challenge. 
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Every cancer treatment, irrespective of its clinical 
effectiveness, has an impact on patients' quality of life 
(QoL). Standard treatments have traditionally included 
chemotherapy, radiotherapy and surgery or a combin- 
ation of these. In recent years, anticancer-targeted 
therapies have been developed for some cancers, and 
very often these greatly contribute to improving both 
survival and QoL [2,3]. Nonetheless, even targeted 
therapies might have side effects and significantly impact 
patients' QoL [4], Thus, understanding the advantages 
and disadvantages (pro and cons) of different treat- 
ments from the patients standpoint has become a must 
in clinical research and is highly valued by major stake- 
holders [5]. 
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Rationale and objective 

Randomized controlled trials (RCTs), play a key role in 
cancer research as they provide the best methodology to 
evaluate treatments and inform health policy and practice. 
Within RCTs in oncology, it is now commonplace to make 
assessment of patient-reported outcomes (PROs). Thou- 
sands of cancer patients are enrolled into RCTs each year 
and many complete relevant PRO instruments to obtain 
patient-centered information as part of the assessment of 
the overall effectiveness of the new therapy. A number of 
these RCTs have generated high quality PRO evidence and 
some of these have also formed the basis for approval (or 
support to approval) of drugs by the US Food and Drug 
Administration (FDA) by showing better PROs with a 
given treatment. Examples of this include mitoxantrone 
for prostate cancer patients and imatinib for patients with 
chronic myeloid leukemia [3,6]. However, it should be 
noted that methodological drawbacks in the design and 
reporting of PROs have often limited the use of PRO data 
in approval of drugs [7]. 

However, a consistent strategy to determine the quality 
of patient centered evidence presented in RCTs has until 
recently been lacking, but is vital to clinicians as PRO 
data from RCTs may directly inform patients and practi- 
tioners regarding the effects of a treatment, or may in- 
directly influence clinical practice by incorporation into 
relevant guidelines [8]. One of the fundamental questions 
when including PROs in clinical research revolves around 
methodological robustness and consistency of outcome 
reporting. There are a number of well known challenges, 
for example, to PRO data collection, appropriate timing 
of assessment, adequate statistical analysis and outcome 
interpretation [9,10]. In addition, the choice of the PRO 
questionnaire is also a fundamental aspect to be consid- 
ered; the questionnaire should be relevant for the specific 
research question, and with solid psychometric character- 
istics (e.g., valid, reliable and responsive to health changes). 
Cancer patients, physicians and healthcare system stake- 
holders need to rely on solid information to make the best 
possible choice regarding treatment. Therefore generating 
high-quality findings from PRO assessment in cancer trials 
is of paramount importance. Poorly designed or reported 
PROs assessment is likely to hamper the critical appraisal 
of results and limit the knowledge transfer from research 
settings to clinical practice. 

The European Organisation for Research and Treatment 
of Cancer (EORTC) Quality of Life Group (QLG) has 
pioneered the field of methodological research in this 
area by developing and validating an international port- 
folio of measures to be used in RCTs in oncology [11]. 
The EORTC has led on several published reviews of 
PRO in RCTs, showing that the application of PROs in 
many trials was plagued by important methodological 
drawbacks, limiting the generalizability of the results 



[12-15]. In response to these findings the EORTC raised 
the need to establish international standards for QoL 
assessment in cancer clinical trials [16] and made sig- 
nificant efforts to define basic minimum criteria to 
guide investigators when reporting HRQOL from can- 
cer RCTs [17]. Further international initiatives have 
subsequently been launched to increase the quality of 
PRO assessment in clinical trials, including guidance 
from the International Society for Quality of Life Re- 
search (ISOQOL) [18]. The ISOQoL guidance is of 
particular value as it formed the basis for the develop- 
ment of the recently issued CONSORT PRO recom- 
mendations [19]. 

In an effort to improve quality of PRO assessment and 
reporting in the near future, the EORTC QLG recently 
contributed to devise the Patient-Reported Outcome 
Measurements Over Time In ONcology (PROMOTION) 
Registry (http://promotion.gimema.it). This is also co- 
financed by the Italian Group for Adult Hematologic 
Diseases (GIMEMA). The broad scope of this Registry is 
to identify, track, analyse, and store information on all 
cancer RCTs that have included PROs, and assess the 
quality of their PRO assessments. This work is being 
performed using a common set of criteria across all 
cancer disease sites, thus allowing comparisons across 
all cancer areas. 



Overview on registry content and type of information 
included 

The database stores information stemming from published 
RCTs that enrolled at least 50 patients overall, that report 
PROs, and that have been published since 2004. To date, 
nearly 600 studies in a wide range of cancer populations 
have been identified, analyzed and electronically archived. 
Data on more than 50 different items have been extracted 
from each eligible study. 

This information is categorized into three broad 
groups, that is: 1) Study characteristics, including sum- 
mary of clinical and PRO results; 2) PRO methodology, 
based on the recently published recommendations by 
ISOQOL [18] and the CONSORT PRO group [19] and 
3) Risk of bias assessed using the Cochrane Risk of Bias 
tool. We acknowledge the evaluation of this latter aspect 
might be challenging by just reading the publication of 
study results, and inspection of full study protocol would 
be valuable. In any case, this tool specifically evaluates the 
adequacy of sequence generation, allocation concealment, 
blinding of participant/personnel, incomplete outcome 
data reporting, blinding of outcome assessment, selective 
outcome reporting and other possible sources of bias 
for each RCT [20]. For descriptive purposes, in Table 1 
we report a summary of some of the key data collected 
in the registry (Table 1). 
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Basic Study 
Characteristics 



Table 1 Descriptive summary of some key data contained in the PROMOTION Registry (http://promotion.gimema.it) 

Name of Cooperative Group/s leading the study (if any) 
Study location 
Industry support 
Primary endpoint/s 

Difference between treatment arms in the primary endpoint (if any) 
Age of patients 
Gender of patients 
Disease stage 
Overall trial sample size 
PRO sample size 
PRO instrument/s used 
Summary of PRO results 

If statistically significant PRO difference exists, details of the domain/s of interest should be reported (e.g. symptoms 
only, functional aspects, global quality of life) 

Summary of main clinical (other than PRO) results 

PRO identification in the abstract 

Statement of PRO hypothesis and its PRO domain 

Description of the mode of administration of the PRO tool and the methods of collecting data 
Electronic mode of PRO administration 
Description of the rationale for choice of the PRO instrument 
Citation of evidence of PRO instrument validity and reliability 
Description of the intended PRO data collection 

Statement of the status of PRO as either a primary or secondary outcome 
Statement of the magnitude of the effect size (for statistically significant PRO results) 
Description of statistical approaches for dealing with missing data 
Statement of the extent of missing data 

Flow diagram or description of the allocation of participants and those lost to follow-up for PROs specifically 
Statement of the reasons for missing data 

Description of the study patients' characteristics including baseline PRO scores 
Reporting of PRO outcomes in a graphical format 
Discussion of the limitations of the PRO components of the trial 
Discussion of the limitations of the clinical significance of the PRO findings 
Methodology used to assess clinical significance 

Discussion of the PRO results in the context of the other clinical trial outcomes 
Selection bias 
Performance bias 
Study Validity Detection bias 

Attrition bias 
Reporting bias 
Abbreviation: PRO (Patient-Reported Outcome). 

Legend: the following aspects are reported for descriptive purposes only. This is not a comprehensive list of all data contained in the PROMOTION Registry. 



PRO Methodology and 
Analysis 



Overview on working methodology 

All published RCTs meeting the inclusion criteria are 
identified by electronic searching of PubMed/Medline, 
the Cochrane library, PsycINFO and PsycARTICLES. 



Hand searching of the bibliographies of eligible articles 
are also performed. 

After eligibility of articles for inclusion is confirmed, a 
minimum of two trained reviewers (who are also study 
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collaborators) independently examine each trial and 
extract pre-specified information. Every reviewer has a 
personal password to access the online system to complete 
the electronic-data extraction form (eDEF), details of 
which have been reported previously [21]. This ap- 
proach allows a double blind data entry procedure to 
ensure accuracy and validity of data entry into the 
Registry. Discrepancies in the independent evaluations 
are recorded and a discrepancy form automatically gen- 
erated by the system. Discrepancies are discussed by 
the two reviewers and resolved by them with a third re- 
viewer reconciling any continuing discrepancies. After 
the review team reach consensus for all items the final 
eDEF for the RCT is locked, validated and imported in 
the Registry for research use. 

Future work and value to the international community 

The methodological challenge of incorporating PROs into 
cancer RCTs is frequently cited as a major limiting fac- 
tor for their use. However, through the PROMOTION 
Registry data we have begun to show that PRO meth- 
odological quality has improved over time in RCTs in 
prostate disease, suggesting that the methodological 
challenges related to PRO logistics, design and analyses 
are no longer insurmountable [21]. 

Work continues within the PROMOTION Registry 
team to determine if this is also the case for other cancer 
sites, and to identify key areas where PRO methodology 
remains poor in cancer RCTs and needs to be addressed 
to facilitate the translation of PRO findings from research 
to clinical practice. 

The PROMOTION Registry (http://promotion.gimema.it) 
is now an extensive source of information for all investiga- 
tors involved in PROs related cancer research and will 
continue to be regularly updated. Data and information 
contained in the registry can be used to address specific 
clinical or more methodological research questions. We 
welcome research proposals from other investigators and 
research groups (not only from GIMEMA and the EORTC 
QLG) to collaborate with the international PROMOTION 
team in the effort to drive PROs into clinical practice and 
better inform healthcare decisions. 
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